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DETAILED ACTION 

1. Claims 1-18 are pending. 

Priority 

2. Acknowledgment is made of applicant's claim for foreign priority under 35 
U.S.C. 119(aHd) from application Number 0322600.8, Country GB, priority date 
September 26, 2003. 

Claim Objections 

3. Claim 1 7 is objected to because of the following infomalities: the word 
"organising" is misspelled. Appropriate correction is required. 

Claim Rejections - 35 USC §112 

4. Claim 1 is rejected under 35 U.S.C. 112, second paragraph, as being indefinite 
for failing to particularly point out and distinctly claim the subject matter which applicant 
regards as the invention, the word "term" in claim 1 is not specific, it is suggested to 
clarify the claimed connotation for "term", in the specification Par [0053] term is referred 
as "A term comprises one or more words". 

* 

Claim Rejections • 35 USC § 101 

5. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

6. Claim 18 is rejected under 35 U.S.C. 101 because the claimed invention is 
directed to non-statutory subject matter. Claim 18 is claiming "a computer program 
product comprising computer program code for causing a computer" which is software 



i 
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per se claim. The descriptions or expressions of the programs are not physical "things." 
They are neither computer components nor statutory processes, as they are not "acts" 
being performed. Such claimed computer programs do not define any structural and 
functional interrelationships between the computer program and other claimed elements 
of a computer which permit the computer program's functionality to be realized. 

For the reason above, claim 1 8 is believed to be non-statutory subject matter. It 
is suggested that Claim 1 8 be amended or recite a computer-implemented method 
at least some of the steps to be performed by a. computer and to recite a method claim 
that produces a concrete and tangible result. 

Claim Rejections - 35 USC § 103 

7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

8. Claims 1-18 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Sahami et al (US Publication No. 2003/0065635 A1), in view of Tukey et a! (US 
Patent No. 5,787,422). 

- A method of determining cluster attractors for a plurality of documents, 
each document comprising at least one term, the method comprising: 
calculating, in respect of each term, a probability distribution indicative of 



Application/Control Number: Page 4 

10/573,482 

Art Unit: 2169 

the frequency of occurrence of the, or each, other term that co-occurs with 
said term in at least one of said documents; calculating, in respect of each 
term, the entropy of the respective probability distribution; selecting at 
least one of said probability distributions as a cluster attractor depending 
on the respective entropy value. 

(Abstract, "...include methods for identifying clusters in a database, data warehouse or 
data mart. The identified clusters can be meaningfully understood by a list of the 
attributes and corresponding values for each of the clusters...") and (Par [0058], "The 
do not care entry is useful in probabilistic algorithms because the frequency of different 
attribute values Is easily computed. For example, the probability that x.sub.1=a is: 1 P ( 
Xl=a) = (x1=a,x2 = *,x3 = *)(x1=*,x2 = *,x3 = *) ,") and (Par [0059]) and 
(Par [0062], "The mutual...") and (Par [0027], "The previously discussed techniques 
were all oriented towards clustering entire sets of data. COBWEB is an online, or 
incremental approach to clustering. FIG. 4 shows a COBWEB tree structure with 
clusters. The clusters are the nodes of the tree. FIG. 4 shows a new data point, X, to be 
added to the data set. COBWEB is based on a probability distribution ..."). 

However Sahami, does not specifically disclose: cluster attractors 
On the other hand Tukey discloses the claimed feature as follow: 
cluster attractors 

(Abstract and Claim 1, "...identifying an attractor for each of a plurality of clusters..."). 
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Therefore, it would have been obvious to a person of ordinary skill in the art at the time 
of invention was made to incorporate the teachings of Tukey into the method of Sahami 
to include cluster attractors based on the probability distribution and entropy value. The 
modification would have been obvious because one of the ordinary skills in the art 
would implement an effective approach to find the best similarities using the cluster 

■ 

attractors and get the closest match to the comparison between the set of values to give 
the user the best probable result. 

As per Claim 2, the rejection of Claim 1 is incorporated and further Sahami discloses: 

- wherein each probability distribution comprises, in respect of each co- 
occurring term, an indicator that is indicative of the total number of 
instances of the respective co-occurring term in all of the documents in 
which the respective co-occurring term co-occurs with the term in respect 
of which the probability distribution is calculated. 

(Par [0012], "One common technique for identifying clusters is the k-means technique. 

■ 

... FIG. 1 shows a set of clusters defined by centroids through the k-means technique. 
The data points are indicated with "." in the two dimensional data domain space. The 
centroids are indicated with "x". The resulting clusters are formed by those data points 
within a certain distance of the centroids as indicated by the ellipsoids.) and (Par [0015] 
The k-means technique is also fairly computationally expensive, especially given that 
additional computational resources will have to be used if any analysis of the clusters is 
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required. In big-0 notation, the kmeans algorithm is O(knd), where k is the number of 
centroids, n is the number of data points, and d is the number of iterations."). 

As per Claim 3, the rejection of Claim 1 is incorporated and further Sahami discloses: 

- wherein each probability distribution comprises, in respect of each co- 
occurring term, an indicator comprising a conditional probability of the 
occurrence of the respective co-occurring term in a document given the 
appearance in said document of the term in respect of which the 
probability distribution is calculated. 

(Par [0015], "The k-means technique is also fairly computationally expensive, especially 
given that additional computational resources will have to be used if any analysis of the 
clusters is required. In big-0 notation, the kmeans algorithm is O(knd), where k is the 
number of centroids, n is the number of data points, and d is the number of iterations.") 
and (Par [0066], "As subsequent clusters are defined, the mutual information will be 
computed as a conditional probability based on the clusters that have already been 
identified: M[(x.sub.i.x.sub.j.vertline.Z), where Z is the set of features previously split on, 
e.g. Z={x.sub.m=a, x.sub.n=d}."). 

As per Claim 4, the rejection of Claim 1 is Incorporated and further Sahami discloses: 



4 
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- wherein each indicator is normalized with respect to the total number of 
terms in the, or each, document in which the term in respect of which the 
probability distribution is calculated appears. 

(Par [0027], "The previously discussed techniques were all oriented towards clustering 
entire sets of data. COBWEB is an online, or incremental approach to clustering. FIG. 4 
shows a COBWEB tree structure with clusters. The clusters are the nodes of the tree. 
FIG. 4 shows a new data point, X, to be added to the data set. COBWEB is based on a 
probability distribution ..."). 

However Sahami does not disclose: 

normalized with respect to the total number of terms in the, or each, 
document in which the term 

On the other hand Tukey discloses the claimed feature as follow: 

(Col. 2, lines 28-47, "...consider the degree of word overlap between the two 
documents of interest, described as sets of words, often with frequency information. 
These sets are typically represented as sparse vectors of length equal to the number of 
unique words (or types) in the corpus. If a word occurs in a document, its location in this 
vector is occupied by some positive value (one if only presence/absence information is 
considered, or some function of its frequency within that document if frequency is 
considered). If a word does not occur in a document, its location in this vector is 
occupied by zero. A popular similarity measure, the cosine measure, determines the 
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cosine of the angle between two sparse vectors. If both document vectors are 
normalized to unit length, this is of course, simply the inner product of the two vectors. 
Other measures include the Dice and Jaccard coefficient, which are normalized word 
overlap counts."). 

Therefore, it would have been obvious to a person of ordinary skill in the art at the time 
of invention was made to incorporate the teachings of Tukey into the method of Sahami 
to normalize with respect to the total number of items. The modification would have 
been obvious because one of the ordinary skills in the art would implement 
normalization to have more flexibility in tuning the results in the probability calculations. 

As per Claim 5, the rejection of Claim 1 is incorporated and further Sahami discloses: 

- comprising assigning each term to one of a plurality of subsets of terms 
depending on the frequency of occurrence of the term; and selecting, as a 
cluster attractor, the respective probability distribution of one or more 
terms from each subset of terms. 

4 

(Abstract and Claim 1 , "A method for determining a cluster from a set of data, the 
cluster comprised of a subset of the set of data, the method comprising: determining a 
set of attributes from the set of data, each of the set of attributes having a 
corresponding set of attribute values..."). 

However Sahami, does not specifically discloses the "and selecting, as a cluster 
attractor" 
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On the other hand Tukey discloses the claimed feature as follow: 

and selecting, as a cluster attractor 

(Abstract and Claim 1, "A method, operating in a digital computer, for searching a 
corpus of documents, comprising the steps of: preparing an initial structuring of the 
corpus into a plurality of primary overlapping clusters, wherein at least two of the 
plurality of primary overlapping clusters contain a single document, wherein the step of 
preparing an initial structuring of the corpus includes the steps of (a) identifying an 
attractor for each of a plurality of clusters..."). 

As per Claim 6, the rejection of Claim 5 is incorporated and further Sahami discloses: 

- wherein each term is assigned to a subset depending on the number 
documents of the corpus in which the respective term appears. 

(Abstract and Claim 1 , "A method for determining a cluster from a set of data, the 
cluster comprised of a subset of the set of data, the method comprising: determining a 
set of attributes from the set of data, each of the set of attributes having a 
corresponding set of attribute values; computing a frequency information for the set of 
attributes; computing a set of relation values using the frequency information, each 
relation value of the set of relation values..."). 

« 

As per Claim 7, the rejection of Claim 5 is incorporated and further Sahami discloses: 



4 
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- wherein an entropy threshold is assigned to each subset, the method 
comprising selecting, as a cluster attractor, the respective probability 
distribution of one or more terms from each subset having an entropy that 
satisfies the respective entropy threshold. 

(Table 1 , "Threshold on influence score For example, it could be required that to further 
subdivide a cluster, the influence score of the highest remaining attribute had to be at 
least 0.05, or 0.1, etc.,.."), "threshold" being "assigned" as claimed. 

However Sahami, does not specifically disclose: cluster attractors 
O n the other hand Tukey discloses the claimed feature as follow: 
cluster attractors 

(Abstract and Claim 1, "...identifying an attractor for each of a plurality of clusters..."). 

Therefore, it would have been obvious to a person of ordinary skill in the art at the time 
of invention was made to incorporate the teachings of Tukey into the method of Sahami 
to include cluster attractors based on the probability distribution and entropy value. The 
modification would have been obvious because one of the ordinary skills in the art 
would implement an effective approach to find the best similarities using the cluster 
attractors and get the closest match to the comparison between the set of values to give 
the user the best probable result. 

As per Claim 8, the rejection of Claim 7 is incorporated and further Sahami discloses: 
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- comprising selecting, as a cluster attractor, the respective probability 
distribution of one or more terms from each subset having an entropy that 
is less than or equal to the respective entropy threshold. 

(Par [0093], "In this example, the institution is a local charity with most of its contributors 
in only one zip code. In step 500, the entropy value for the zip code attribute will be low, 
reflecting its non-uniformity. In this example, a predetermined threshold has been 
established and attributes with an entropy higher than the threshold are eliminated. In 
this example, the entropy for the zip code attribute within the example set of data does 
not exceed the threshold and zip code is will not be eliminated as an attribute.") 

However Sahami, does not specifically disclose: cluster attractors 
O n the other hand Tukey discloses the claimed feature as follow: 
cluster attractors 

(Abstract and Claim 1, "...identifying an attractor for each of a plurality of clusters..."). 

Therefore, it would have been obvious to a person of ordinary skill in the art at the time 
of invention was made to incorporate the teachings of Tukey into the method of Sahami 
to Include cluster attractors based on the probability distribution and entropy value. The 
modification would have been obvious because one of the ordinary skills in the art 
would implement an effective approach to find the best similarities using the cluster 
attractors and get the closest match to the comparison between the set of values to give 
the user the best probable result. 
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As per Claim 9, the rejection of Claim 5 is incorporated and further Sahami discloses: 

- wherein each subset is associated with a frequency range and wherein 
the frequency ranges for respective subsets are disioint 

(Abstract and Claim 5, "The method of claim 1, wherein the computing a frequency 
information for the set of attributes comprises performing a CUBE operation on the set 
of data for the set of attributes that computes the frequency information.") 

However Sahami, does not specifically disclose: for respective subsets are disioint 
O n the other hand Tukey discloses the claimed feature as follow: 

for respective subsets are disjoint 

(Col. 13, lines 8-16. "This output is then the inner cluster information that is more 
precise than that which is obtained either from a non-disjoint or a disjoint clustering 
of all documents in the input corpus.. Alternatively, since the inner clusters need not 
span the next-upward cluster to which they belong, intermediate clusters can be defined 
corresponding to each of the overlapping clusters and consisting of all documents, in 
that overlapping cluster, for which the corresponding attractor is the closest attractor.") 

Therefore, it would have been obvious to a person of ordinary skill in the art at the time 
of invention was made to incorporate the teachings of Tukey into the method of Sahami 
to include disjoint frequency values for each subset. The modification would have been 
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obvious because one of the ordinary skills in the art would implement an effective 
approach to find the best similarities using the cluster attractors and get the closest 
match to the comparison between the set of values to give the user the best probable 
result. 

As per Claim 10, the rejection of Claim 5 is incorporated and further Sahami discloses: 

-wherein each subset is associated with a frequency range, the size of 
each successive frequency range being equal to a constant multiplied by 
the size of the preceding frequency range in order of increasing frequency. 

(Par [0076], "One enhancement that can improve the quality of the decision tree is to 
form subsets. Once an attribute x. sub.i has been selected based on the influence for 
x.sub.i, the attribute with which x.sub.i had the highest mutual information value is also 
known, e.g. x.sub.j. By writing out vectors for the frequency of the various attribute 
values of x.sub.j for each of the attribute values of x.sub.i, a decision can be made as to 
whether subsetting is appropriate.") and (Par [0009], "As the number of attributes 
increases, the vector increases in length. For n attributes, a data point X can be 
represented by an n-vector:"). 

As per Claim 11, the rejection of Claim 7 is incorporated and further Sahami discloses: 
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- wherein the respective entropy threshold increases for successive 
subsets in order of increasing frequency. 

(Par [0093], "In this example, the institution is a local charity with most of its contributors 
in only one zip code. In step 500, the entropy value for the zip code attribute will be low, 
reflecting its non-uniformity. In this example, a predetermined threshold has been 
established and attributes with an entropy higher than the threshold are eliminated. In 
this example, the entropy for the zip code attribute within the example set of data does 
not exceed the threshold and zip code is will not be eliminated as an attribute."). 

As per Claim 12, the rejection of Claim 1 1 is incorporated and further Sahami 
discloses: 

- wherein the respective entropy threshold for successive subsets 
increases linearly. 

(Par [0009], "As the number of attributes increases, the vector Increases in length. 
For n attributes, a data point X can be represented by an n-vector:") and (Par [0087] In 
some embodiments, a predetermined value can be used to automatically eliminate 
attributes with higher entropies. Alternatively, the m attributes with the highest entropies 
can be eliminated. Alternatively, the j attributes with the lowest entropies can be the only 
ones used in clustering."). 
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As per Claims 13. the rejection of Claim 1 1 is incorporated and further Sahami being 
the computer program product comprising computer program code for causing a 
computer to perform the method corresponding to the method 1 , respectively and 
rejected under the same reason set forth in connection of the rejections of Claim 1 , and 
further Sahami discloses: (Abstract and Claim 22, "... the computer program including a 
first set of instruction for determining..."). 



As per Claims 14, being the apparatus claim corresponding to the method 1, 

respectively and rejected under the same reason set forth in connection of the 
rejections of Claim 1, and further Sahami discloses: (Title: "METHOD AND 
APPARATUS FOR SCALABLE PROBABILISTIC CLUSTERING ...") 

As per Claim 15, the rejection of Claim 1 is incorporated and further Sahami discloses: 

A method of clustering a plurality of documents, each document 
comprising at least one term, the method comprising determining cluster 
attractors in accordance with Claim 1 . 

(Par [0137], "FIG. 11 shows the output ... The remaining portion 1102 of the 
document (web browser display is scrolled to see all of it) is the output from the 
clustering process."). 

■ 

However Sahami does not specifically teaches: 
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comprising at least one term, the method comprising determining cluster 
attractors 

On the other hand Tukey discloses: 

comprising at least one term, the method comprising determining cluster attractors 

(Col. 10, lines 34-44, "...a particular cluster based upon its "closeness" to the cluster's 
attractor as, for example, described above. However, the present invention further 
modifies the closeness criterion, which would result in disjoint (non-overlapping) 
clusters. The modification of the clustering is accomplished by adding to each cluster at 
least one document found in another cluster. As illustrated by step 88, the number of 
additional clusters is determined as a fraction of the number of documents in each 
cluster.") 

Therefore, it would have been obvious to a person of ordinary skill in the art at the time 
of invention was made to incorporate the teachings of Tukey into the method of Sahami 
to include cluster attractors based on the probability distribution and entropy value. The 
modification would have been obvious because one of tlie ordinary skills in the art 
would implement an effective approach to find the best similarities using the cluster 
attractors and get the closest match to the comparison between the set of values to give 
the user the best probable result. 

As per Claim 16, the rejection of Claim 15 is incorporated and further Sahami 
discloses: 
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- comprising: calculating, in respect of each document, a probability 
distribution indicative of the frequency of occurrence of each term in the 
document; comparing the respective probability distribution of each 
document with each probability distribution selected as a cluster attractor; 
and assigning each document to at least one cluster depending on the 
similarity between the compared probability distributions. 

(Abstract, "...include methods for identifying clusters in a database, data warehouse or 
data mart. The identified clusters can be meaningfully understood by a list of the 
attributes and corresponding values for each of the clusters...") and (Par [0058], "The 
do not care entry is useful in probabilistic algorithms because the frequency of different 
attribute values is easily computed. For example, the probability that x.sub.1=a is: 1 P ( 

■ 

Xi=a) = (x1=a,x2 = *,x3 = *)(x1=*,x2 = *,x3 = *) ,") and (Par [0059]) and 
(Par [0062], "The mutual...") and (Par [0027], "The previously discussed techniques 
were all oriented towards clustering entire sets of data. COBWEB is an online, or 
incremental approach to clustering. FIG. 4 shows a COBWEB tree structure with 
clusters. The clusters are the nodes of the tree. FIG. 4 shows a new data point, X, to be 
added to the data set. COBWEB is based on a probability distribution ...."). 

However Sahami, does not specifically disclose: cluster attractors 

On the other hand Tukey discloses the claimed feature as follow: 

> 

cluster attractors 

(Abstract and Claim 1, "...identifying an attractor for each of a plurality of clusters..."). 



Application/Control Number: Page 18 

10/573,482 

Art Unit: 2169 

Therefore, it would have been obvious to a person of ordinary skill in the art at the time 
of invention was made to incorporate the teachings of Tukey into the method of Sahami 
to include cluster attractors based on the probability distribution and entropy value. The 
modification would have been obvious because one of the ordinary skills in the art 
would implement an effective approach to find the best similarities using the cluster 
attractors and get the closest match to the comparison between the set of values to give 
the user the best probable result. 

As per Claim 17, the rejection of Claim 16 is incorporated and further Sahami 
discloses: 

- comprising organising the documents within each cluster by: assigning a 
respective weight to each document the value of the weight depending on 
the similarity between the probability distribution of the document and the 
probability distribution of the cluster attractor ; comparing the respective 
probability distribution of each document In the cluster with the probability 
distribution of each other document in the cluste r: assigning a respective 
weight to each pair of compared documents, the value of the weight 
depending on the similarity between the compared respective probability 
distributions of each document of the pair; calculating a minimum 
spanning tree for the cluster based on the respective calculated weights. 
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(Par [0013], "In order to position the centroids and define the clusters, the k-means 
technique relies on the existence of a similarity, or distance, function for the 
domain....") and (Par [0017], "...Then, at the next step, a similarity, or distance 
function is used to find the closest pair of smaller clusters, which are then merged into a 
larger cluster...") and (Par [0027], "The previously discussed techniques were all 
oriented towards clustering entire sets of data. COBWEB is an online, or incremental 
approach to clustering. FIG. 4 shows a COBWEB tree structure with clusters. The 
clusters are the nodes of the tree. FIG. 4 shows a new data point, X, to be added to the 
data set. COBWEB is based on a probability distribution ...") and (Par [0039] FIG. 1 
illustrates the centroids and clusters determined by the k-means algorithm on a data 
set with two attributes and k=3.") and (Par [0069] The attribute with the highest influence 
is then selected. The selected attribute is the one upon which the remaining attributes 
are most heavily dependent.) and (Par [0070] One optimization is to sum over the k- 
maximal terms instead of all of the other attributes in computing the influence. In this 
embodiment, only the k mutual influence values with the highest values are summed for 
each attribute."), the k-means algorithm, being the "calculating a minimum spanning tree 
for the cluster". 

However Sahami, does not specifically disclose: 
cluster attractors 

respective weight to each document 
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assigning a respective weight to each pair of compared documents, the 
value of the weight depending on the similarity 

On the other hand Tukey discloses the claimed feature as follow: 

cluster attractors 

(Abstract and Claim 1 , "...identifying an attractor for each of a plurality of clusters..."). 
respective weight to each document 

assigning a respective weight to each pair of compared documents, the value of 
the weight depending on the similarity 

(Cols. 6 and 7, lines 65-68 and 1-12, respectively, "partially described so as to enable a 
similarity determination. A document may, for example, be represented as a one- 
dimensional array or vector of features, where the array contains an entry for each 
feature in the corpus to which the document belongs and where the document array has 
a non-zero entry to indicate that the feature occurs within the document. A feature may 
be a word, a statistical phrase, an algorithmically rotated coordinate (such as those 
obtained from singular value decomposition (SVD) analysis of the word by document 
matrix), or similar unit of understanding into which the document may be divided. SVD is 
a matrix factorization technique. Basically, a words versus document co-occurrence 
matrix is factored via SVD and only the highest weighted rotated"). 
Therefore, it would have been obvious to a person of ordinary skill in the art at the time 
of invention was made to incorporate the teachings of Tukey into the method of Sahami 
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to include cluster attractors based on the probability distribution and entropy value. The 
modification would have been obvious because one of the ordinary skills in the art 
would implement an effective approach to find the best similarities using the cluster 
attractors and get the closest match to the comparison between the set of values to give 
the user the best probable result. 

As per Claim 18, being the computer program product comprising computer program 
code corresponding to method Claim 1 5 respectively and rejected under the same 
reason set forth in connection of the rejections of Claim 18, and further Tukey discloses: 
(Col. 4, lines 50-65, "In accordance with another aspect of the present invention, there 
is provided a document browsing system for use with a corpus of documents stored in a 
computer system, the document browsing system comprising: program memory for 
storing executable program code..."). 

Conclusion 

9. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Angelica Ruiz whose telephone number is (571) 270- 
3158. The examiner can normally be reached on 7:30 a.m. to 5:00 p.m., ET. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor. Mohammad Ali can be reached on (571) 272-4105. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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